Web Survey Bibliography
Title Can Using a Mixed Mode Approach Improve the Representativeness and Data Quality in Panel Surveys?
Author Stern, M. J.
Year 2016
Access date 01.06.2016
Abstract
A proposed solution to the current challenges associated with individual mode surveys is to recruit panels of respondents who agree to complete a series of surveys over the internet. However, this approach has been criticized given that surveyors do not fully understand the way different segments of society use the web and the homogeneity of samples.Recently, surveyors have explored the use of mixing modes for panels. There is some evidence that mixed-mode surveys can improve the
representativeness of a sample. For instance, web only approaches exclude important and often underrepresented segments of the population. However, web surveys supplemented by a subsequent mail questionnaire produced results similar to those of mail-only surveys, but at an increased monetary cost to the researcher. There are also some additional concerns researchers must consider in using a mixed-mode approach. For instance, mixing modes can lead to differences in substantive responses due to one mode favoring a certain socio-demographic over another mode, e.g., RDD attracting older homeowners whereas web-only surveys are more apt to obtain responses from younger people. Another source of differences stems from mode of presentation with visual self-administered surveys often obtaining different answers than aurally administered questionnaires. In this research, we explore these issues with data from the NORC Amerispeak Panel, which recruits web panelist using a mail and telephone recruitment but subsequently follows up with a sample of non-respondents using in-person, face to face interview techniques. The results from this work focus on the demographic variability and changes in substantive responses relative to national benchmarks in order to understand the balance between potential mode effects and a representative sample.
representativeness of a sample. For instance, web only approaches exclude important and often underrepresented segments of the population. However, web surveys supplemented by a subsequent mail questionnaire produced results similar to those of mail-only surveys, but at an increased monetary cost to the researcher. There are also some additional concerns researchers must consider in using a mixed-mode approach. For instance, mixing modes can lead to differences in substantive responses due to one mode favoring a certain socio-demographic over another mode, e.g., RDD attracting older homeowners whereas web-only surveys are more apt to obtain responses from younger people. Another source of differences stems from mode of presentation with visual self-administered surveys often obtaining different answers than aurally administered questionnaires. In this research, we explore these issues with data from the NORC Amerispeak Panel, which recruits web panelist using a mail and telephone recruitment but subsequently follows up with a sample of non-respondents using in-person, face to face interview techniques. The results from this work focus on the demographic variability and changes in substantive responses relative to national benchmarks in order to understand the balance between potential mode effects and a representative sample.
Access/Direct link Conference Homepage (abstract)
Year of publication2016
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - Stern, M. J. (13)
- An Examination of How Survey Mode Affect Eligibility, Response and Health Condition Reporting Rates...; 2016; Stern, M. J.; Ghandour, R.
- Mode and Eligibility Rates in a Dual-mode Web and Mail Survey ; 2016; Ventura, I.; Bilgen, I.; Stern, M. J.
- Can Using a Mixed Mode Approach Improve the Representativeness and Data Quality in Panel Surveys?; 2016; Stern, M. J.
- Spatial Modeling through GIS to Reveal Error Potent ial in Survey Data: Where, What and How Much ; 2016; English, N.; Ventura, I.; Bilgen, I.; Stern, M. J.
- Where Does the Platform Matter: The Impact of Geographic Clustering in Device Ownership and Internet...; 2015; Bilgen, I.; English, N.; Stern, M. J.; Ventura, I.
- Comparing Field and Laboratory Usability Tests to Assess the Consistency and Mistakes in Web Survey...; 2015; Croen, A.; Gonzales, N.; Ghandour, R.; Stern, M. J.
- Question Grouping and Matrices in Web Surveys: Using Response and Auxiliary Data to Examine Question...; 2014; Bilgen, I., Stern, M. J.
- Can Google Consumer Surveys Help Pre-Test Alternative Versions of a Survey Question?: A Comparison of...; 2013; Stern, M. J., Welch, W. W.
- How Do Different Sampling Techniques Perform in a Web-Only Survey? Results From a Comparison of a Random...; 2013; Bilgen, I., Stern, M. J., Wolter, K.
- Are Response Rates to a Web-Only Survey Spatially Clustered?; 2013; Fiorio, L., Stern, M. J., English, N., Bilgen, I., Curtis, B.
- How Representative are Google Consumer Surveys?: Results From an Analysis of a Google Consumer Survey...; 2013; Krishnamurty, P., Tanenbaum, E., Stern, M. J.
- The effects of item saliency and question design on measurement error in a self-administered survey; 2012; Stern, M. J., D., Mendez, J. D.Smyth, J. D.
- Comparing Check-All and Forced-Choice Question Formats in Web Surveys: The Role of Satisficing, Depth...; 2005; Smyth, J. D., Dillman, D. A., Christian, L. M., Stern, M. J.